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ABSTRACT 



Because of inadequate preservice and in-service 
mathematics training programs, a critical need existed to provide 
quality in-service mathematics instruction for teachers in sparsely 
settled areas of Appalachia. A computer assisted instruction (CAI) 
course was developed for use with the IBM 1500 system which utilized 
an integrated approach relying on tutorial activity at the computer, 
printed instructional materials, and manipulative devices to be used 
at the terminal and in the classroom. Four hundred and forty-four 
students registered for the course; 387 completed the course. Using 
data compiled from this field study the achievement and attitudes of 
the students were evaluated and the relationships among achievement, 
attitude, and time measures were analyzed. Student opinion toward CAI 
was surveyed. Using this data as feedback some revisions were made in 
the curriculum. A table of references, a course description, and a 
sample of the opinion questionnaire are appended. (JY) 
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PREFACE 



The conception of an idea to place a computer-instructional system in a 
mobile facility in order to provide inservice education for school personnel 
throughout Appalachia and other areas which are geographically difficult to 
reach can be traced to a letter written by Harold E. Mitzel, Assistant Dean 
for Research in the. College of Education at The Pennsylvania State University, 
to Dr* Benjamin Carmichael , Director of the Appalachia Educational Laboratory, 
Inc., at Charleston, West Virginia, in May 1967. Much time and effort was 
devoted to nurturing this idea by the staff of the Appalachia Educational 
Laboratory, the Computer Assisted Instruction Laboratory at Penn State, and 
the International Business Machines Corporation. The Appalachia Educational 
Laboratory concentrated their effort on developing interest among the public 
school people in Appalachia and developing the financial support for such a 
project. The staff of the CAI Laboratory at The Pennsylvania State University 
concentrated much effort into revising and polishing a course in modern mathe- 
matics for elementary school teachers and the addition of components to the 
course to provide specific instruction in methods of teaching. Staff members 
from the IBM. Corporation focused their attentions on the engineering and support 
personnel . 

About. March 1 , 1969, an IBM 1500 instructional system was delivered to 
the United Data Processing facility in Dryden, Virginia, and installed ready 
for operation about ten days later. After serving the needs of the elementary 
school teachers in this community, it was then moved to the Gladeville elemen- 
tary School in Gladeville, Virginia, to provide the inservice mathematics pro- 
gram between May 19 and July 7. It was then moved to the Phi lipsburg elemen- 
tary School in California, Pennsylvania, where it served between July 14 and 
August 29 * The program served a total of 387 students during the three 
settings of fie project. 

Many edi 'ators have heard that there is such a phenomenon as computer- 
assisted instruction, but most are unaware that the technique is beyond the 
developmental or laboratory stage and is ready for limited operational use in 



carefully selected situations. One such educational si tuation for which' there 
is an urgent need is the retraining and upgrading of teachers who are currently 
in service. Because teachers frequently find it impossible for personal rea- 
sons to return to college campuses, the re-education they need should be taken 
to them. This solution to the problem of inservice education gave rise to the 
"extension class," which has enjoyed widespread application during the past 
four decades. It is, however, getting more and more difficult to staff these 
field courses with .qualified instructors. Hence, the whole field of continu- 
ing education is ripe for a technological innovation that will bring quality 
instruction to practitioners in the field. This final report, based on the 
previous interim reports from the Dryden, Gladeville, and California experi- 
ences, shows that the computer-assisted instruction technique is successful. 

The students, many of whom thought that they were through with learning activ- 
ities, show growth i n . knowl edge and a high degree of enthusiasm for the indi- 
vidualized technique to which they were exposed. 

Although a great deal remains to be done that will improve the operation 
of a mobile computer-based instruction unit in the field, we believe that we 
have demonstrated the feasibility find desirability of incorporating CAI 
programs into . inservice teacher education. 



Keith A. Hall 
January 1970 
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COMPUTER-ASSISTED INSTRUCTION IN APPALACHIA 



Need 

The importance of early mathematics education to students’ intellectual 
growth is becoming increasingly evident. It is clear that elementary school 
teachers have an obligation to keep up to date and better informed in mathe- 
matics--not only about happenings which have implications for their teaching 
content, but also how the process of mathematics instruction might be improved. 

However, an objective look reveals that the mathematics teaching skills 
of Appalachian elementary school teachers are, in too many instances, inade- 
quate. There are two important reasons for this condition. The first reason 
is lack of effective preservice preparation. The Committee on Undergraduate 
Programs in Mathematics (CUPM) has recommended four mathematics courses for 
the preservice training of elementary school teachers. Relatively few col- 
leges and universities have been able to make such arrangements. In fact, 
many new teachers entering the field have the same level of expertise in mathe- 
matics as those who presently are there. 

The second reason is lack of adequate inservice education. Although many 
programs are offered at the state and local levels, these programs have been 
generally sporadic, of short duration, poorly staffed, and frequently designed 
solely to cope with some emergency (such as an adoption of a new textbook 
series). 

Furthermore, attempts to improve the quality of this inservice education 
within the current educational framework have been frustrated by the diffi- 
culties in .attracting master teachers, obtaining college credit, and arranging 
for release time. 

Relatively few Appalachian elementary school teachers have attended a 
federally sponsored institute of any kind, mainly because these institutes 
generally require an extended stay away from home. In Pennsylvania, for 
example, it. is estimated that there are in excess of 58,000 elementary school 
teachers .(based on an elementary school population of 1 ,716,252), and only 
188 of these have attended a federally sponsored institute (Bureau of Statis- 
tics, 1967, 1968). 
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Because of inadequate preservice and inservice mathematics training pro- 
grams , there is widespread agreement that a critical need exists for new 
methods of providing quality inservice mathematics instruction . 

In spite of the unsatisfactory conditions of current inservice programs, 
studies indicate that quality improvements in inservice training can and should 
be accomplished. Huettig and Newell (1964), for example, found that teachers 
with courses in modern mathematical content have a significantly better atti- 
tude toward curricular change in mathematics. Rudd (1957) found inservice 
courses- to be of a higher caliber when, individual background was taken into 
consideration, and the inservice course was accomplished at the local level in 
close proximity to the elementary classroom. 

Another, important finding was reported by Houston, Boyd, and DeVault 
(1962), who worked with 252 elementary teachers in a multi-media approach using 
closed circuit television, lecture, question-discussion, and written materials. 
They indicated that teachers preferred the written materials and the question- 
discussion approach of teaching. The researchers stated, "The findings of this 
study would [sic] indicate that administrators should consider procedures for 
individualizing inservice education programs for teachers." Dutton (1966) also 
noted that use of programed instructional materials seemed to provide numerous 
opportunities to diagnose students' subordinate knowledge and skills essential 
for sound sequential learning and expansion of mathematical concepts. In 
another study, Dutton and Hamlin (1966) stated that the identification of 
weaknesses teachers have in understanding the new mathematics and teaching to 
overcome - those weaknesses should be an important part of an inservice program. 

The' research, suggests that proposed teacher improvement programs should be 
based on the question^discussion method, individualized programs, and programed 
instructional materials. Computer-assisted instruction is the one techno- 
logical innovation which can utilize all of these components in one comprehen- 
sive program. 

Based on these studies and considerations of alternative programs , i t is 
concluded , therefore , that a_ computer-based program in modern mathemati cs 
the best choice for accelerating the accessibi 1i ty of quali ty inservice educa- 
tion for mathematics teachers in Appalachia . 
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The primary target of the program was the teacher of elementary pupils 
in sparsely settled areas of Appalachia. The stereotype of this teacher is 
that of a woman who would have to double as a housewife and student long 
enough to attend college classes to upgrade her knowledge in modern mathemat- 
ics. This dual responsibility often prevents the teacher from attending 
college; she will therefore spend another fifteen years in the classroom with 
no improvement in the quality of her service unless new techniques of in- 
service education are provided. Computer-assisted instruction offers the 
potential for meeting inservice training needs of the students, teachers, and 
the administration. 

Objectives 

The goal of the project was to field test a program of inservice educa- 
tion in modern mathematics and mathematics teaching methods for elementary 
teachers in the Appalachian region. An IBM 1500 instructional system was first 
installed in Dryden, Virginia, then in Gladeville, Virginia, and finally in 
California, Pennsylvania, to administer the computer-based course to the 
teachers. This system was used during later afternoon and evening hours to 
provide individualized instruction for elementary school teachers who drove in 
from a radius of approximately 20 miles. Records of the learning histories of 
the participating teachers were compiled and analyzed for evaluating the effec- 
tiveness of the course and for making course revisions. 

Computer - Configuration 

The IBM 1500 student station consists of four optional display/response 
devices which may be used individually or in combination. The central instru- 
ment connected to the computer consists of a cathode-ray tube screen with 
sixteen horizontal rows and forty vertical columns for a total of 640 display 
positions. ^ Information sufficient to fill the screen is available in micro 
seconds from an internal random access disk. A light-pen device enables the 
learner to respond to displayed letters, figures and graphics by touching the 
appropriate place on the screen. A part of the CRT device is a typewriter- 
like keyboard which makes it possible for the learner to construct responses, 
have them displayed at any author-desired point on the CRT screen arid receive 
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rapid feedback in the form of an evaluative message. Four dictionaries of 128 
characters each of the course author's own design are capable of being used 
simultaneously; thus, it would be technically feasible to teach the symbols of 
Sanskrit, Chinese, English, and Greek simultaneously by means of CAI. An image- 
projector loaded with a 16mm microfilm is capable of holding 1000 images on a 
single roll and of accessing forty images per second under program control. An 
audio play/record device has recently become available but was not utilized for 
this project. An electric typewriter on the system is a separate device which 
enables the student to receive a hard copy of the interaction or dialogue 
between himself and the computer. 

The system's central processor which can accommodate up to a total of 
thirty-two student stations (each complete with four devices) is an IBM 1130 
computer with 32,768 words of core storage. (Sixteen stations were sufficient 
to allow 150 - 200 students to complete the instructional materials used for 
this project in about 8 weeks.) In addition to the usual peripheral equipment, 
the central processor depends upon five IBM 2310 disk drives (2,560,000 words) 
for the storage of usable course information and operative instructions. Twin 
magnetic tape drives record the interaction between the program and the student 
for later analysis and course revision. Core storage cycle time is 3.6 micro- 
seconds and read/write time for disk storage is 27.8 microseconds per word. 

Instructional. Program 

The computer-assisted instruction course in mathematics for elementary 
teachers and methods of teaching mathematics for elementary teachers was devel- 
oped by Professors C. Alan Riedesel, Marilyn N. Suydam, and Cecil R. Trueblood 
of The Pennsylvania State University. The course adheres rather closely to 
the CU PM Level 1 recommendation with about 80 per cent of the course devoted 
to mathematical content and 20 per cent devoted to the methods of teaching 
mathematics* The methods units were interspersed throughout the program so 
that each- would be studied immediately following the presentation of the 
related content. 

The course- utilizes an integrated approach relying not only on tutorial 
activity at the computer terminal but on the integration of printed instruc- 
tional materials and manipulative devices to be used at the terminal and in the 
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teacher's classroom. Each participant in the project received a copy of 
Guiding Discovery in Elementary School Mathematics , by C. Alan Riedesel, and 
published by Appleton -Century Crofts, a handbook containing suggested lesson 
plans and problem assignments, and an assortment of manipulative devices, such 
as Cuisenaire rods and counting sticks to use in their classroom. A course 
description is included in Appendix A of this report. A pre- and posttest 
of mathematics content, and pre- and posttest of the participant's attitude 
toward mathematics, and a posttest of attitude toward CAI were administered 
to the participants in the project. The data from these inventories are 
documented elsewhere in this report. 

Participants 

Of the 444 students who registered for the course, 387 of them completed 
the course. Most of those who discontinued the course did so after they had 
attended one or two sessions and had discovered that the content of the course 
was not appropriate for their interests or background. Only one person was 
unable to complete the course because of lack of time at any setting. The 
enrollment by occupation and location is presented in Table 1. Of the 387 
students who completed the course, 243 were enrolled for and received college 
credit for the course from one of the ten institutions of higher learning who 
agreed to offer credit for the course. The distribution of the institutions 
granting credit at each location is presented in Table 2. 

Course Completio n Time 

According to the computer clock records, the average completion time was 
19 hours. This average does not include pretest cime, posttest time, or time 
used to take the "SOS" CAI opinion test at the student station. It also does 
not include time that students may have spent seated at a terminal but not 
signed on to the course itself. Minimum clock time for the fastest students 
(mostly high school math teachers) was 12 hours with the maximum completion 
time being about 56 hours. 
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EVALUATION OF ACHIEVEMENT 




Harold E. Mitzel and Marilyn N. Suydam 

The central question to be asked of any instructional program is, "Do the 
learners who are exposed to the program reach the objectives of instruction?*' 

It is also useful to know the extent to which the instruction can be said to 
be causally related to the achievement of the objectives. Our goal in devel- 
oping measures of achievement for the CAI modern mathematics course was to try 
to embrace the concepts of criterion-referenced testing as opposed to norm- 
referenced testing which depends upon classical psychometrics. In this connec- 
tion, criterion-referenced achievement tests have to bear a much closer corre- 
spondence to the actual instructional material than is customary with the 
relative achievement measures used in normative evaluations. Our test-building 
efforts in this program of assessing the modern mathematics achievement of 
Appalachian .inservice elementary teachers represents only an initial, imperfect 
attack on a new and difficult problem. 

An ideal criterion-referenced test from a psychometric viewpoint would be 
one with items that no learner got corrfect prior to instruction and that every 
learner answered correctly at the end of instruction. (Parenthetically, it 
should be noted that such a test would have zero reliability.) Pragmatically, 
this need for a test of maximum change has to be balanced by the necessity of • 
maintaining the motivation of learners in the pre-test situation by asking 
some questions which students, legitimately though uninstructed, can answer 
correctly. The criterion-referenced test cannot include so-called "transfer 
of training", questions unless those specific objectives have been included in 
the program of. instruction. And, in order to be effective, the criterion- 
referenced test- must measure achievement of predetermined instructional objec- 
tives rather than general intelligence. It will be clear to the reader that 
we did not achieve our instrumentation goals on the first attempt, but enough 
has been learned from this series of three presentations of the CAI modern 
mathematics course to make a major modification in the achievement test. 
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Development of the 
Mathematics Achievement Test 

The "Test on Modern Mathematics," Forms G and H (by Marilyn N, Suydam, 
Cecil R. Trueblood, and C. Alan Riedesel) was developed to serve as a pre- and 
posttest measure of achievement for the computer-assisted mathematics course 
for elementary teachers (Elmath). The multiple-choice test was designed to 
provide a representative sampling of mathematical content from each of the 
twelve chapters in the course in order to measure understanding of the major 
concepts contained in the CAI mathematics program. Although about twenty per 
cent of the student's "on-line" time dealt with the material on the teaching 
of mathematics in the elementary school, questions from this content were not 
included in the achievement examination. 

From a pool of approximately 300 multiple-choice questions composed of 
items used to test a previous version of the course (Long and Riedesel, 1967), 
the basic examination was constructed. The pool had been developed by writing 
test questions which fit the knowledge, understands rig, and application objec- 
tives included in each chapter. Texts in mathematics education which were 
used to construct the course were consulted in the preparation of the test 
questions. In addition, the authors of the test were assisted by a mathemati- 
cian who evaluated each item for appropriateness to the course material and 
for mathematical accuracy. This test in our opinion represents a first 
approximation to a criterion- referenced examination on which a population of 
elementary teachers should be expected to achieve a mastery level of about 
ninety per cent after instruction. 

Form G of the "Test on Modern Mathematics" was used as the pretest, while 
Form H served as the posttest. The two forms contain the same items, except 
that: 1) the numerical values are changed in about one-half of the examples, 

and 2) the order of answer options is different on almost all items. Because 
there were no substantive changes in content or format, we make the assumption 
that Forms G and H are equivalent. Time and the appropriate number of experi- 
mental subjects from the population of elementary school teachers were not 
available to collect the data needed to establish psychometric equivalence. 

“3 

Table 3 shows the pre- and post- treatment results of the administration 
of the "off-line! 1 mathematics achievement test. A total of 342 persons from 
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Descriptive Summary of 30-item Mathematics Achievement Test Scores (in per cent) 
for -342 Educators Taught by CAI at Three Locations 
Spring and Summer 1969 
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three different locations provided usable and identifiable answer sheets for 
the two test administrations, which were taken approximately seven weeks apart. 
In the intervening period, the teachers spent an average of nineteen hours on 
the course material. 

In studying the results of Table 3, we make the assumption that the eighty 
items of the test represent an absolute criterion of achievement in this course 
and that theoretical mastery of the course objectives is attained when a stu- 
dent answers all eighty items correctly. In most practical achievement testing 
situations, a ninety per cent criterion is ordinarily considered realistic. In 
the case of Forms G and H, we find considerable discrepancy from that goal, 
which we attribute to two causes. First, the items, being a first cut, do 
contain some "transfer of knowledge" objectives which were not specifically 
taught in the CAI program. Second, there are probably not enough direct prac- 
tice materials and short quizzes within the program to enable the less able 
students to reach all of the desired objectives. The first difficulty can be 
overcome by a careful re-examination of the hierarchy of tasks involved in the 
solution of the problems. The second difficulty can be ameliorated by addi- 
tions and deletions to the program of instruction. As shown in Table 3, 
approximately fifty per cent of the students had, by virtue of their perform- 
ance on the pretest, already achieved fifty per cent of the content objectives 
of the course. For tnis group, there was relatively little room to grow and, 
in the pragmatics of an insarvice teacher education offering, it was impossible 
to withdraw the opportunity for self-improvement from the students once the 
pretest results were available. 

We have omitted the usually reported measures of test reliability based 
on the discriminating power of the accumulated test questions. These con- 
siderations are inappropriate for situations where mastery of subject matter 
is desired instead of each learner's relative position on an achievement scale. 

In spite of the imperfections in the achievement test (and/or the instruc- 
tion program), the data show that the students at the three locations were able 
to increase their median achievement from approximately fifty per cent to about 
seventy-five per cent after a seven-week period of concentrated instruction via 
CAI. Roughly, a twenty-five per cent increase in mathematics knowledge can be 
attributed to the impact of the course within the interpretative limitations of 
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the test’s characteristics. No other experiences with the content of mathemat- 
ics were reported by the students during the seven-week period. Indeed, by 
teaching a full schedule in the Virginia or Pennsylvania public schools and 
commuting to the CAI installations two or three days per week, little time 
could have remained to the teachers for independent study of mathematics. 

No attempt has been made to evaluate the small differences between means 
of students from the three locations because we were not concerned with the 
geography of mathematical achievement. Indeed, a meaningful comparison is 
impossible because of our inability to generate representative samples from 
extant populations of educators. 



EVALUATION OF ATTITUDES TOWARD MATHEMATICS 



Marilyn N. Suydam and Harold E. Mitzel 

When a new instructional technique becomes available, educators frequently 
are interested in the attitudinal effects of the methodology on the subject 
matter being taught. Computer-assisted instruction is of particular interest 
in this connection because of humanistic fears that machines will somehow 
replace fundamental human activities. In the case of attitudes toward mathe- 
matics and things mathematical, we are, to be sure, more concerned with pupils 
than with teachers. However, if computer usage can awaken dormant interests 
of elementary teachers in mathematics, then they may be able to transmit an 
enthusiasm and positive attitude to their pupils. For these reasons, we were 
interested in studying attitude change on the part of Appalachia elementary 
teachers who spent a seven-week period on a computer-assisted instruction 
course in modern mathematics. 

Development of the 
Mathematics Attitude Scale 

The "Attitude Toward Mathematics" scale (by Marilyn N. Suydam and Cecil R. 
Trueblood) was developed from a pool of seventy- five items selected to express 
various feelings toward mathematics. The Likert format was used with each 
statement worded in such a way that its content is favorable or unfavorable 
toward the subject under study. Students then respond in terms of the extent 
to which they agree or disagree with the statement. Neutral items are not 
included. To reduce the potential effect of response set, care was taken to 
include an equal number of positively worded (favorable to mathematics) and 
negatively worded (unfavorable to mathematics) items. 

The seventy- five item pool was submitted to twenty-five examinees who 
were asked to respond to each item with a five-point scale ranging from 
"strongly agree" to "strongly disagree." Scale scores were then d zed for 
each item, and the final selection of twenty-six items was based on: 1) the 

level of the scale scores and 2) independence of content of the item. 
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The value of the variate on the attitude scale was obtained by assigning 
arbitrary numerical weights to the options according to the following scheme:^ 





Strongly 

Disagree 


Disagree 


Undecided 


Agree 


Strongly 

Agree 


Positively Worded Items 


1 


2 


3 


4 


5 


Negatively Worded Items 


5 


4 


3 


2 


1 



The theoretical extremes of a distribution of scores with 26 items are 26 
and 130. 

On administrations of the "Attitude Toward Mathematics" scale to several 
hundred students, the reliability (i.e., a measure of internal consistency, 
Cronbach's Coefficient Alpha) has ranged from .9207 to .9793, with an average 
reliability of .9554. 

Results 

The "Attitude Toward Mathematics" scale was administered on a pretest, 
posttest basis to the adults enrolled in the computer-presented Elmath course 
at Dryden, Virginia; Gladeville, Virginia; and California, Pennsylvania. The 
scale was given at the time of registration or at the first instruction ses- 
sion. After the seven-week instruction period, the students were given the 
scale items and a response sheet with instructions to mail in their reactions 
at their earliest convenience. 

Table 4 summarizes the pre-post attitudinal data for 320 students from 
the three combined locations. Our interest here was in ascertaining the 
nature of the impact of the CAI experience on attitudes toward mathematics. 
Fears that interaction with computer terminals might generate negative feelings 



Items are scored on a one- to- five basis rather than zero-to-four in 
order to facilitate computer processing of the data. Specifically, when zero 
scores can legitimately occur, the computer cannot easily distinguish zeroes 
from omits unless a special character compare function is performed. This 
operation must be carried out for each item score which substantially increases 
processing time. Consequently, the computer program was written to handle 
positive, non-zero numbers. 




Table 4 

Descriptive Summary of Pre- and Posttest Attitude Scale Scores for 320 Educators 
Taught Mathematics by CAI at Three Appalachia Locations 
Spring and Summer 1969 
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toward' subject matter were unfounded. The average pre-post difference of +3.3 
points reassured the authors that the CAI work in mathematics had not "soured" 
our students on the importance or their acceptance of mathematics. Hopefully, 
further computer use in teacher education will illuminate the subject of mathe- 
matics and the teaching of mathematics in such a way that greater enthusiasm 
for it will be demonstrated by elementary teachers who will, in turn, communi- 
cate that excitement to their young pupils. 
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ANALYSIS OF RELATIONSHIPS AMONG 
ACHIEVEMENT, ATTITUDE, AND TIME MEASURES 

Harold E, Mitzel 

In previous sections of this report we have summarized and presented the 
accumulated evaluative data from three locations at which the inservice CAI 
program was presented. In the present section our data are restricted to the 
last two locations, Gladeville, Virginia, and California, Pennsylvania, omit- 
ting the Dryden, Virginia, data which were not available in sufficient detail 
for these analyses. 

Variability of 
Time on Terminal 

It seems to be a universal phenomena that CAI as an educational medium 
maximizes differences between learners in the amount of time required for task 
completion. Our current experience is no exception to this finding as shown 
in Table 5. We believe that programs of instruction even richer in individu- 
alizing techniques and remedial exercises will expand the variability that we 
have found. Our data show that one person spent more that 39 hours at the 
terminal and 3 persons out of the group of 222 spent 9 hours or less at the 
computer terminal in the same course of instruction. This slowest-to-fastest 
ratio of four or five to one is characteristic of previous experiences with 
the course. The fact that the California, Pennsylvania, group required almost 
three hours less of terminal time is partially explained by three conditions: 
1) California educators brought somewhat higher pre-course modern mathematics 
skills to the experience than Gladeville students, 2) the offering during the 
summer recess at California instead of during the school term enabled the 
Pennsylvania educators to take advantage of slightly fewer but longer sessions 
on the average than Virginia teachers, 3) by constantly improving the quality 
of the program stored in the computer, we were able to reduce slightly the 
average completion time required by our subjects, thus favoring those 'who were 
last on the revised material. 
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Table 5 

Frequency Distributions of Number of Hours of Terminal Time 
for Educators Taught Modern Mathematics- by CAI 
at Two Locations, Spring and Summer 1969 



Frequency 



Number of 
Hours 


Gladeville, Va. 
(N=133) 


California, Pa. 
(N=89) 


Total 

(N=222) 


Cumulative 

Percentage 


39.1 - 


- 


1 


0 


1 


100.0% 


36.1 - 


39.0 


0 


0 


0 


99.5 


33.1 - 


36.0 


4 


1 


5 


99.5 


30.1 - 


33.0 


2 


1 


3 


97.3 


27.1 - 


30.0 


6 


5 


11 


95.9 


24.1 - 


27.0 


13 


3 


16 


91.0 


21.1 - 


24.0 


25 


6 


31 


83.8 


18.1 - 


21.0 


21 


11 


32 


69.8 


15.1 - 


18.0 


32 


25 


57 


55.4 


12.1 - 


15.0 


20' 


24 


44 


29.7 


9.1 - 


12.0 


9 


10 


19 


9.9 


- 


9.0 


0 


3 


3 


1.4 


*Mean 




19.65 


16.82 


18.51 




Median 


18.81 


15.92 


17.34 




Mode 




17.05 


17.05 


17.05 




*Std. 


Dev. 


5.79 


5.26 


5.74 





Descriptive statistics calculated from ungrouped data. 



It Is noteworthy that about 70 per cent of the students were able to com- 
plete the material in 21 or fewer clock hours. Authors of the course judge 
that the same amount of subject matter is typically presented in lecture dis- 
cussion classes in 35-40 clock hours. 




Concentration of 
CAI Instruction 



Tables 6 and 7 which follow, provide ample evidence of the degree to which 
adult learners will, when given the opportunity, choose to vary the concentra- 
tion of their instruction. The typical adult student attended about nine 
separate sessions at the computer terminal and spread his instruction over a 
period of 30 calendar days. The “booking" arrangements for individualized 
instruction which we made with these students were designed to make CAI maxi- 
mally flexible. It is clear from these data that our students took advantage 
of the opportunities afforded them. In making the course as flexible as pos- 
sible we have probably ignored the wisdom generated in previous research on 
massed versus distributed practice (Underwood, 1961). We believe the CAI format 
with its control of stimulus materials offers a good opportunity to re-examine 
previous conclusions about learning. 

Interrelationships Between Achievement , 

Attitude , and Time Measures 

It is often useful in explorations of new techniques to examine the inter- 
relationships between pairs of the principal variables in order to formulate 
hypotheses for future definitive studies. In this instance, we show in Table 8, 
the pair-wise relationships among seven variables for something over two hun- 
dred subjects at two Appalachia locations. There are two achievement variables, 
a pretest and a posttest; two attitude-toward-CAI variables, a pretest and a 
posttest; and three time measures, number of hours at student terminal, number 
of separate CAI sessions, and number of calendar days between first and last 
session. Table 9 which follows, is intended to provide a reference for the 
reader who wishes to examine the means and standard deviations for the seven 
variables. 

Table 9 presents the product-moment correlations between the paired obser- 
vations for these seven variables. It was expected that a high positive cor- 
relation would be found between achievement pre- and posttest scores. This is 
a generally prevalent finding since what a student achieves may be partially 
predicted by his entering level, or what he has achieved in the past. The 
correlation coefficient of .7962 is therefore an indication that high achievers 
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Table 6 



Frequency Distributions for Number of Sessions on Terminal 
for Educators Taught Modern Mathematics by CAI 
at Two Locations, Spring and Summer 1969 



Number of 
Sessions 





Frequency 




Cumulative 

Percentage 


Gladevllle, Va. 
(N=120) 


California, Pa. 
(N=89) 


Total 

(N=209) 


21 - 22 


1 


0 


1 


100.0% 


19 - 20 


0 


1 


1 


99.5 


17 - 18 


3 


1 


4 


99.0 


15 - 16 


3 


2 


5 


97.1 


13 - 14 


4 


5 


9 


94.7 


11 - 12 


19 


14 


33 


90.4 


9-10 


38 


22 


60 


74.6 


00 

1 


32 


22 


54 


45.9 


5 - 6 


13 


18 


31 


20.1 


3 - 4 


4 


4 


8 


5.3 


CM 

1 

O 


3 


0 


3 


1.4 


*Mean 


9.07 


8.79 


8.95 




Median 


8.92 


8.55 


8.78 




Mode 


9.50 


8.50 


9.50 




*Std. Dev. 


3.18 


3.09 


3.13 





Descriptive statistics calculated from ungrouped data. 
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Table 7 

Frequency Distributions for Number of Days 
Intervening Between Initial and Final Sessions 
for Educators Taught Modern Mathematics by CAI 



Frequency 



Number of 
Days 


Gladeville, Va. 
(N=l 20) 


California, Pa. 
(N=89) 


Total 

(N=209) 


Cumulative 

Percentage 


44 - 47 


1 


0 


1 


100.0% 


40 - 43 


6 


0 


6 


99.5 


36 - 39 


5 


3 


8 


96.7 


32 - 35 


10 


6 


16 


92.8 


28 - 31 


26 


10 


36 


85.2 


24 - 27 


18 


3 


21 


67.9 


20 - 23 


18 


11 


29 


57.9 


16 - 19 


10 


13 


23 


44.0 


12 - 15 


18 


12 


30 


33.0 


8 - 11 


5 


17 


22 


18.7 


4 - 7 


2 


14 


16 


8.1 


0-3 


1 


0 


1 


0.5 


*Mean 


24.30 


17.15 


21.25 




Median 


24.83 


15.96 


21 .22 




Mode 


29.50 


9.50 


29.50 





Descriptive statistics calculated from ungrouped data. 
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Zero-Order and Partial Correlations Between Measures on Seven Variables 
for Educators Taught Modern Mathematics by CAI 
at Two Locations, Spring and Sunnier 1969 
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at terminal 19.65 5.79 133 16.82 5.26 89 18.51 5.74 222 

Number of separate sessions 9.07 3.18 120 8.79 3.09 89 8.95 3.13 209 

Number of days between first 

and last session 24,30 9.05 120 17.15 9.37 89 21.25 9.83 209 
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on the pretest tended to be high achievers on the posttest, and low achievers 
tended to achieve at the lower levels on both tests. If, however, the achieve- 
ment test were a completely satisfactory mastery or criterion-referenced test, 
this correlation should be decidedly lower. The goal in aiding the student to 
achieve mastery of a body of material is precisely to eliminate a strong pre- 
post achievement test relationship. All students, whether they scored high or 
low on the pretest, should reach approximately the same high level on the post- 
test if the individualized course of instruction is optimized. The present 
achievement test for the course as well as the course itself is undergoing 
revision in order to more closely approximate the goal. 

That the attitude pre- and posttest scores were highly correlated was also 
predictable. Measurable changes in attitude generally demand a longer time span 
than the seven weeks of this project. The correlation coefficient of .8316 is 
indicative that some relative changes in attitude did occur among the partici- 
pants; as previously noted, the mean attitude score became slightly more posi- 
tive during the instruction period, though the difference did not exceed chance 
variation. 

The correlation coefficients between measures of achievement and attitude 
toward CAI on the one hand, and time assessments on the other, are all low 
negative. This observation is merely indicative of the fact that longer periods 
of time spent by students on the course tended to be associated with lower 
achievement, both pre and post. It is, of course, difficult to say that one 
set of variables is causally related to the other. 

The negative coefficients between achievement and attitude on the one hand 
and time-on-course measures on the other, however, are generally not extreme. 

One exception is the relationship between pre- and posttest achievement and 
amount of time on the terminal (-.5366 and -.5635, respectively). High 
achievers typically spent less time at the student station than low achievers. 
Again we see some weakness in the combination of instructional programs/exami na- 
tions, since theoretically learners with lower ability or lower previous knowl- 
edge should be able to use "time on the program" to compensate for their poor 
starting position. 

Amount of time on terminal was found to be positively related to the number 
of sessions (.7035) and the number of lapsed days between first and last session 
(.4337). That these coefficients were no higher is relates to the flexibility 
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of scheduling possible with a CAI system. The coefficient of .5935 between 
numbers of sessions and lapsed days is similarly related to scheduling con- 
straints . 

The data relating to time "on-line" and achievement were also analyzed in 
another way to study the relationships existing between them. Correlations 
between posttest achievement and each measure of time were determined when 
achievement pretest scores were used as a co-varia*.e, or held constant. Thus 
it was possible to look at the relationship which would have existed had all 
pretest achievement scores been equal. The correlation coefficients between 
posttest achievement score and number of lapsed days (with pretest achievement 
constant) was -.0147, while the posttest achievement coefficient with number of 
sessions was -.0644 under the same conditions. Both of these coefficients are 
statistically nonsignificant. However, the coefficient between posttest 
achievement and number of hours on terminal (with pretest achievement constant) 
was -.2670. When pretest achievement was uncontrolled, the corresponding coef- 
ficient was -.5635, indicating that a portion, but not all, of the relationship 
between achievement and time on the terminal is explained by what the learner 
brings with him in the way of subject matter knowledge. 

Summary 

The adaptions spontaneously made by the students in terms of length of 
CAI sessions, number of different sessions, and spread of instruction over 
number of days tend to emphasize one of the potentially important advantages 
of computer-based instruction. A maximum amount of flexibility seems to be cf 
particular significance for inservice or jt- > concurrent training. We believe 
that the educational demand for inservice education is going to increase 
markedly in the years immediately ahead, and that CAI, based on our field 
experiences in Appalachia can help to satisfy that burgeoning need. 




EXPRESSED STUDENT OPINION 
TOWARD COMPUTER-ASSISTED INSTRUCTION 

Karl G. Borman 

The evaluation of an educational innovation such as computer-assisted 
instruction is a multi-dimensional problem. One aspect of this evaluation is 
the student's opinion of the innovation. 

It is generally acknowledged that the personality of the teacher is of 
major importance to what is learned in the classroom (Bugelski, 1964). If the 
teacher is flat or dull, the words that he uses will become conditioned stimuli 
for boredom and apathy. If he is mean, sarcastic, or irritable, his words will 
come to create emotional reactions of resentment. Similar reactions should 
result when a computer is substituted for a teacher. However, research evidence 
(Eigen and Feldhusen, 1964; Wodtke, Mitzel, and Brown, 1965) has indicated that 
student opinion toward computer-assisted instruction may not be of much conse- 
quence relative to the amount learned. Brown (1966) has suggested that the pre- 
vious studies were conducted over too short a period of time to allow the 
effects of opinion toward computer-assisted instruction to affect learning. 

The student opinion survey described in this section of the report is an 
instrument designed to measure a student's opinion toward computer-assisted 
instruction (CAI) as an educational technique. 

The Student Opinion Survey (SOS) 

The instrument Is composed of 42 items related to the student's experi- 
ences while taking a course via CAI. The items were adapted from a paper and 
pencil test previously developed at Penn State (Brown, 1966) and later revised 
on tne basis of the data collected at Dryden, Virginia, (Hall , .1969). 

The student taking the opinion survey uses the light pen attached to the 
cathode ray tube (CRT) to indicate the degree to which he agrees with a state- 
ment (strongly agree, agree, uncertain, disagree, strongly disagree) for 26 of 
the questions. Sixteen questions require the student to rate the degree of 
applicability of the statement by using the light pen to point to one of the 
following responses: all of the time, most of the time, some of the time, very 

seldom, or never. Twenty six of the 42 questions are negatively worded (see 
Appendix B). A weight between 1 and 5 is assigned to each response to indicate 
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the degree to which the response describes a favorable opinion toward CAI. 

This method of weighting provides for a spread of scores between 42, indicating 
the least favorable opinion toward CAI, and 210, indicating the most favorable 
opinion toward CAI. A theoretical neutral score would be 126. 

Based on the data collected at Dryden, Virginia, (Hall, 1969) provisions 
were made in the opinion survey to give the student the opportunity to type any 
comment (up to 200 characters) he wished to make related to a particular item 
in order to clarify or explain the reasons for his answer. 

Provision was also made to allow a student to type a response of not more 
than 200 characters explaining why he did or did not like CAI. This section 
of the opinion survey followed the 42 structured items. The typed comments 
were not scored and were not included as part of the student's score. 

Administration 

The administration procedures varied from site to site. Each site 
utilized an improved administration procedure made possible by technological 
improvements. 

While the students at Dryden, Virginia, were taking the modern mathematics 
course, a sign was posted instructing the students to sign on to SOS between 
chapters 8 and 10. Of the 129 students who completed El mat, 116 followed 
the instructions. Twenty-seven students 1 data were discarded because of a 
machine malfunction which was later corrected. Eighty-nine students at 
Dryden, Virginia, provided the data for that report. 

At Gladeville, Virginia, the students were instructed to sign-on to SOS 
upon completion of the modern mathematics course. Ninety-one of the 138 
students followed these instructions. However, 28 of the students completed 
SOS before the course was revised and these students were excluded from the 
analysts. Sixty-three students provided the data for that report. 

The California, Pennsylvania, site provided the highest degree of control 
for the administration of the Student Opinion Survey. Upon the completion of 
the modern mathematics course, the students were automatically administered 
the opinion survey. Eighty-nine students provided the data for that report. 

At all sites, the students were told to be frank, that there was no one 
right answer to a question, that their opinions would be kept confidential, 
and that they were required to answer each question. 
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Resul ts 

Because the students at Dryden, Virginia, were administered a different 
version of the opinion survey midway through the course on modern mathematics 
than the students at Gladeville and California, separate analyses were per- 
formed on the data from Dryden. The results of two analyses, Dryden. separately, 
and Gladeville and California combined, will be presented here. 

The coefficient alpha reliability (Cronbach, 1951) of the Student Opinion 
Survey administered at Dryden, Virginia, was .84 while the coefficient alpha 
reliability of the survey administered at the two other combined locations 
was .85. 

The mean student opinion score obtained at Dryden was 154.4 and the mean 
average student opinion score at the remaining two locations was 155.6. The 
entire distribution of scores for both analyses is shown in Table 10. 

It was hypothesized that a student’s opinion toward CAI may be related to 
his performance in mathematics and the time required to complete the course. 
Correlations between student opinion scores and mathematics achievement post- 
test scores, and between student opinion scores and total time to complete the 
CAI course, were obtained and are reported in Table 11. Any discrepancies 
between the number of subjects used in these analyses and the number of subjects 
used in previous analyses are the result of not having opinion survey data, 
completion time, and posttest performance data available. 

Only the correlation between student opinion survey scores and the mathe- 
matics achievement posttest scores obtained at Dryden, Virginia, was signifi- 
cantly different from zero. Individual analyses performed at the Gladeville 
and California sites did not produce correlations significantly different from 
zero between these same variables. The same finding is also shown in the single 
analysis using the combined Gladeville and California data. All of the other 
correlations were not significantly different from zero. 

Discussion 

Accepting the statement that a score of 126 indicates a neutral opinion 
toward CAI, then the conclusion follows that the students on the whole expressed 
a favorable opinion toward computer-assisted instruction because a mean score 
of 155.2 was obtained for all 243 of the students. Only 8 out of 243 students 
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Table 10 

Distribution of Student Opinion Survey Scores 



Frequency 

Gladeville and 



Score 


Dryden Data 


California Data Combined 


180 - 189 


3 


6 


170 - 179 


6 


19 


160 - 169 


24 


36 


150 - 159 


26 


45 


140 - 149 


18 


29 


130 - 139 


8 


12 


120 - 129 


3 


5 


110 - 119 




2 


N 


89 


154 


*Mean 


154.29 


155.40 


Median 


155.08 


155.94 


Mode 


154.5 


154.5 


*St. Dev. 


13.00 


14.23 


Reliability 


.84 


.85 



* 



Descriptive statistics were calculated from ungrouped data. 
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Table 11 

Means, Standard Deviations, and Correlation Coefficients 
of Two Variables Hypothesized to Affect 
Student Opinion Survey Scores 





Variable 


Mean 


S. D. 


Correlation 
with SOS 


P 


Dryden, Virginia (N = 


86) 








Mathematics 

Achievement 

Posttest 


59.95 


11.97 


.27 


< .01 


Time Required to 
Complete the CAI 
Course on Modern 
Mathematics 


21.45 


6.14 


.06 


N. S. 


Gladeville, Virginia, 


arid 








California, Pennsylvania (N = 147) 








Mathematics 

Achievement 

Posttest 


57.63 


12.85 


.08 


N. S. 


Time Required to 
Complete the CAI 
Course on Modern 
Mathemati cs 


17.69 


5.96 


-.02 


N. S. 
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obtained student opinion survey scores of 126 or less. The low correlation 
between student opinion survey scores and mathematics achievement posttest 
scores or time required to complete the CAI course also indicates that both 
high and low achievers expressed favorable opinions toward computer-assisted 
instruction; and those students who rapidly completed the CAI course on modem 
mathematics, as well as those who required longer periods of time, also expressed 
favorable opinions toward CAI. 

The one exception to these general findings is the .27 correlation 
between student opinion scores and mathematics achievement posttest scores 
obtained at Dryden, Virginia. At the present time, the most feasible explana- 
tion is that this correlation is significant by chance alone, since this result 
was not duplicated. at subsequent locations. However, the possibility does . 
remain that this result is due to the fact that the opinion survey was adminis- 
tered approximately two-thirds of the way through the course. This hypothesis 
must be retained until more data are obtained. 

Student Comments 

The favorable attitudes of students toward CAI methodology are also veri- 
fied by the unstructured comments typed upon conclusion of the 42 inventory 
items of the student opinion survey by the students at Gladeville and 
California. Some typical comments follow: 

I liked this course because it's the first time I've even 
remotely enjoyed any type of math (except geometry). I think I've 
learned something at last. 

It was a lot of fun— stimulating. 

Mathematics is not one of n\y favorite subjects. The computer 
made it seem a bit different. 

Have always actively disliked math; thoroughly enjoyed this 
course. 

I liked the CAI course very much. In high school I hated math. 

A fine course. 

Thank you for your ideas. 

CAI made learning fun and enjoyable. 

I was pleasantly surprised at the lack of tension I felt in 
taking a course that was always difficult for me to master. There 
was a high degree of motivation. Congratulations and thanks. 
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. . .You look forward to attending classes. 

The course was fun. 

I appreciated flexibility in scheduling. 

It gave some insight into the method of presentation of 
materials. 

I liked CAI because I could take the courses at my 
convenience. 

I felt the course was tremendous in every way. The experience 
was great. Thank you for making it possible, and your interest in 
me as a student and teacher. 

I liked CAI because you received immediate feedback for your 
responses. I am normally very poor in mathematics and I feel that 
it [CAI] has helped me gain a better understanding of some concepts. 

There were also some negative comments, the most common was that the 
students could not get the computer to accept alternative correct answers. 
For example: 

I felt, at times, that I needed someone to explain things more, 
and to discuss things with me. 

I became a little upset when the computer refused correct 
answers because of different terms. Otherwise, I've enjoyed the 
class . 

i did enjoy this course. I realize that you are only a machine 
arid that there is much improvement to be made, example, your 
acceptance of responses. On the whole I found it quite interesting. 



Conclusion 

An overwhelming majority of all the students completing the computer- 
assisted instruction course of inservice mathematics education for elementary 
school teachers at Dryden, Virginia, Gladeviile, Virginia, and California, 
Pennsylvania, obtained scores on the Student Opinion Survey which indicated 
that the students had a favorable opinion toward computer-assisted instruction. 
This opinion was not related to a person's mathematical achievement or to the 
time required to complete the CAI program. The comments typed by the students 
upon the completion of the survey also verify these conclusions. From these 
findings, we inferred that the students were highly motivated to learn and would 
be willing to take further instruction via CAI. 
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CURRICULUM REVISIONS 
Cecil R. Trueblood 

Since the computer can automatically record and store all or selected 
student responses and response times, the instructors or course authors can 
later obtain a print-out of this student record data by means of special 
instructions. The purpose of this report segment is to indicate the type and 
number of curriculum revisions which were made based on the analyses of student 
records and on-site observations. 

The following procedures were used to determine what curriculum revisions 
might be made. A request was made for a one-line summary of student perform- 
ance for each question in the course. See Table 12 for an example of the types 
of data contained in the one-line summary. 

Table 12 

Example of Data in a 
One-line Summary 



Ep Identifier 9 


Students 13 


Attempts 0 


% Attempts > 2° 


Mean Latency 1 


D62xl 


2 


10 


50 


5.00 


D62x2 


2 


3 


0 


1.50 


D62x3 


2 


4 


50 


2.00 


D65 


10 


14 


9 


1.40 



identifies each question in the course. 

^Number of students who have been presented with this question, 
c 

Total number of attempts to respond correctly by all students who 
received the question. 

^Per cent of attempts greater than two. 

e Mean response latency in seconds. 
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The data in the one-line summary were analyzed to determine which question 
might be causing students difficulty. For any question where the mean number 
of attempts was greater than two, another request was made to obtain detailed 
student records. See Table 13 for an example of the types of data contained in 
the detailed student records. 



Table 13 

Sample of Student Records for One Student (YAMG) 
on Elmat-4, Question Do5 



Course 3 


Seg. b 


S c 


Ep Ident.d 


Match e 


Attempt 


El mat 


4 

Responses 


YAMG 

- mioio 9 


D65 


UU 


1 


Elmat 


4 

Responses 


YAMG . 

- iinoicr 


065 


UU 


2 


El mat 


4 

Responses 


YAMG D65 

- 1011010 (two)i 


CC 


3 



a Name of course - el mat. 
b Segment no. 4. 

c Student: YAMG-Y denotes Dryden setting, AMG are the student's 
initials. 

identifies the question in the course. 

identifies the type of response in the course which the student matched: 
UU - unanticipated response, CC - correct response. 

f 

Indicates which attempt the data refers to for a given student - 1st 
attempt, 2nd attempt, etc. 

g, h, and i^ c ^ ua -| reS p 0 nse made by the student. 



Using the data in the detailed student records and the original program, 
the authors determined whether a revision of course content or Coursewriter II 
instructions might improve student performance. The number and types of revi- 
sions made are shown in Table 14 and discussed on the following page. 



ERIC 
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Table 14 

Number of Curriculum Revisions by Type 
and Location Where Data Were Collected 



Operation Codes 
Requiring Revisions 


California 

Pa. 


Dryden 

Va. 

Number of Revisions 


Gladeville 

Va. 


Total 


pr 






5 


5 


ep 


5 




6 


11 


lp responses 


4 


7 


3 


14 


ca 


5 






5 


ca feedback 


3 


7 




10 


cb 






9 




wa 








9 


wa feedback 


4 


38 


3 


45 


un feedback 


13 


16 


9 


38 


fn 


11 


125 


3 


139 


dt 


7 




3 


10 


Branch 




9 




9 


Image Reel 




19 




19 


Op code 




11 


4 


15 


Typographical 






3 


3 


Context 




26 




26 


Student Handbook 




12 




12 


Total 


52 


270 


48 


370 



In addition to the revisions based upon student records, the recommenda- 
tions of the proctors and the systems manager were used to generate new frames 
for several chapters.. Since the need for these changes was not reflected by 
student records, this source of information proved to be very useful in 
improving the program. Two types of revisions. were made based upon these on- 
site observations. New frames were added after which the old and new frames 
were resequenced to improve the course flow. 
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Unanticipated Answers (WA, CA, and UN Feedback) 

This type revision was made when students gave correct or incorrect 
answers (which had not been anticipated by the authors) and received inappro- 
priate feedback. A comparison of lines 11 and 16 on the following print-outs 
(Fig. 1 and Fig. 2) illustrate how these frames were revised to provide appro- 
priate feedback. Line 11 (Fig. 2) shows that students will now receive appro- 
priate feedback for the WA's “count" and "number." Line 16 shows that the 
answers "one-to-one" and "1-to-l" will not be given correct answer feedback. 



1 pr 

2 de 0/32 

3 dt 0,0/6,0/40,0/Readiness for studying cardinal number 
of sets can begin with each child using 

a small flannel board and the 

4 dt ,0/2, /40,0/materials shown on the image projector. 

5 fpl 27 

6 dt ,0/4, /40,0/What should the teacher ask pupils to do 
if they can't find any likenesses? 

7 ep 16 ,0/2 ,1 6/40 ,0//99/l xl 7 

8 fn ed//bO,d//A 

9 de 24/8 

10 aa */aa 

11 Id .match. pair. corres.compar/b2 

12 fn mk///. 

13 fn es/nw/l/.///c 

14 dt 24 ,0/4, 24/ 40, 0/Good, After pairing they recognize that 
for each boy there's a ball. 




Fig. 1. Frame print-out before revision. 
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1 pr 

2 de 0/32 

3 dt 0,0/6, 0/40, 0/Readiness for studying cardinal number 
of sets can begin with each child using 

a small flannel board and the 

4 dt ,0/2,0/40,0/materials shown on the image projector. 

5 fpl 27 

6 dt ,0/4, /40,0/What should the teacher ask pupils to do 
if they can't find any likenesses? 

7 ep 16,0/2, 16/40,0////1x17 

8 fn ed//bO,d//A 

9 de 24/8 

10 aa */aa 

11 Id count number/b2 

12 fn mk///A 

13 fn ex/nw/l/'A///w 

14 dt 24,0/4,24/40 ,0/What type of correspondence would help? 

15 aa */aa 

16 Id .match. pair. corres. compar. ltol ,onetoone.b2 

17 fn mk///. 

18 fn es/nw/l/.///c 

19 dt 24,0/4,24/40 ,0/Good. After pairing they recognize that 
for each boy there’s a ball. 



Fig. 2. Frame print-out after revision— unanticipated answers. 

Context R evisions 

This type revision was necessary when the wording in either initial ques- 
tions or possible answers delated student progress. In the following example, 
student record analysis indicated that the initial question was too general to 
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elicit the specific terms desired. An examination of lines 3 and 4 in the 
following frame print-outs (Fig. 3 and Fig. 4) indicates what text was added 
to cause students to consider two specific types of sets. 



1 prr 

2 de 0/32 

3 dt 2, 0/6 ,2/40,0/ After numerous matching exercises the 
teacher should be able to introduce the 

children to what type of sets? 



Fig. 3. Frame print-out before revision. 



1 prr 

2 de 0/32 

3 dt 2, 0/6, 2/40,0/ After numerous matching exercises the 
teacher should be able to introduce the 

children to what type of sets? Type 

4 dt ,0/2, /40,0/either equal or equivalent. 



Fig. 4. Frame print-out after revision— context revisions. 

Branch Revisions 

These revisions were made when student records indicated that some stu- 
dents could advance more rapidly or that some students needed additional 
instruction. In the following case, student records Indicated that if a stu- 
dent correctly answered question c06, he did not need the additional examples 
in the branch c06xl and c06x2„ The program was revised as Indicated In the 
following flowcharts (Fig. 5) so that students who correctly answer c06 go 
directly to cQ7. 



o 
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Initial Branch Revised Branch 







Fig. 5. Flowcharts of program frame showing initial branch and revised branch. 
Image Reel Revisions 

For several questions student records and on-site observations indicated 
that the content of the accompanying image reel frames was impeding student 
progress. In these cases, students had difficulty Identifying the correct 
answers to questions because the accompanying image reel frames were not 
labeled. The revision was simply to label the objects on those Images. After 
all revisions for a reel were made, the complete image reel was rephotographed. 

ERIC 
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FN ^visions 

These function revisions made the program more sophisticated in that it 
allowed and accepted more varied responses from the students. In the following 
example (Fig. 6), the addition of the edit function in line 5 takes out spaces, 
parentheses, and the correct base subscript. In the revised form (Fig. 7) if 
the student answers with any combination of spaces, parentheses, and the correct 
base subscript, his answer will be accepted. 



1 


prr 




2 


de 


0/32 


3 


dt 


0,0/2,0/40,0/What is 724 


4 


ep 


2 ,0/2 ,2/40 ,0//99/d'f 8 


5 


aa 


* 


6 


Id 


1324/b2 


7 


fn 


mk///A 


8 


fn 


es/nw/l/A///c 


9 


dt 


16,0/2,16/40,0/Correct. 


10 


pa 


20 


11 


br 


dl 9 


12 


un 


un 


13 


de 


16/2 


14 


dt 


1 6 ,0/2 ,16/40 ,0/1 ncorrect 


15 


pa 


20 


16 


br 


d!8xl 



(ten) in base eight? 



724(ten) = 1324(eight). 



Let's try some smaller steps. 




Fig. 6. Frame print-out before revision. 
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1 prr 

2 de 0/32 

3 dt 0,0/2,0/40,0/What is 724(ten) in base eight? 

4 ep 2,0/2, 2/40 ,0//99/dl 8 

5 fn ed////A/(/)/eight 

6 ca 1324/cc 

7 de 16/2 

8 dt 16,0/2,16/40,0/Correct. 724( ten) = 1324(eight) . 

9 pa 20 

10 br dl 9 

11 un un 

12 de 16/2 

13 dr 16,0/2,16/40,0/Incorrect. Let's try some smaller steps. 

14 pa 20 

15 br dl8xl 



Fig. 7. Frame print-out after revision— FN revisions. 

In some cases the student's typing caused him to receive the feedback for 
an unidentified answer. For example, before an appropriate edit function was 
added, the response "FOUR" was not accepted as a correct answer, only "four" 
was accepted; therefore, the edit function in line 5 (Fig. 8 and Fig. 9) was 
used to downshift all capital letters and to i;ake out all spaces. 

OP Code Revisions 

The need for OP code revisions to gain the desired course affect was 
determined from on-site observations. 

One PA (pause) revision altered the length of pause between multiple light- 
pen responses. This revision was necessary to keep students from becoming 
confused about whether or not the computer had accepted their first choice and 
was prepared to accept their second choice. Also, if the student responds with 
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1 

2 

3 



4 

5 

6 

7 

8 
9 

10 

11 



12 

13 



prr 

de 0/32 

dt 0,0/6,0/40,0/Consider the letters in the word "card." 

How many members or elements are in 

this set of letters? 

ep 8,0/2,8/40,0//99/a3 

de 16/16 

ca 4/cc 

cb four/cc 

dt 16,0/2,16/40,0/4 is correct, 
pa 20 
un un 

dt 16,0/6,16/40,0/The word "card" has four letters. How 
many elements would this ta? Now answer 
again, 
un un 

dt 16, 0/6, 16/40, 0/"Card" contains 4 letters. Therefore, 
there are four elements in this set 
of letters. Type 4. 



Fig. 8 Frame print-out before revision 

a wrong answer, the computer now, 1) erases any previous feedback, 2) pauses, 
3) gives the new feedback, 4) pauses, and allows the student to begin his 
next attempt. 

The OP code revisions also permit: 1) changing an EP (enter and process) 

to give students more space in which to construct his response, 2) inserting 
an EP when there wasn't one so that students can answer, 3) inserting a UN 
(unrecognized answer) to correct the flow of the program, and 4) inserting a 
PR (problem start) at the beginning of a frame. 



O 
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1 prr 

2 de 0/32 

3 dt J, 0/6, 0/40, 0/Consider the letters in the word "card." 
How many members or elements are in 

this set of letters? 

4 ep 8,0/2 ,0/40,0//99/a3 

5 fn ed//bO,d//A 

6 de 16/16 

7 ca 4/cc 

8 cb four/cc 

9 dt 16,0/2,16/40,0/4 is correct. 

10 pa 20 

11 un un 

12 dt 16,0/6,16/40,0/The word "card" has four letters. How 
many elements would this be? Now answer 

again. 

13 un un 

!4 dt 16, 0/6, 16/40, 0/"Card" contains 4 letteis. Therefore, 

there are four elements in this set 
of letters. Type 4. 



Fig. 9. Frame print-out after revision--FN revisions. 

The omission of the PR in the example frame (Fig. 10) affected the course 
flow in that students received the frame labeled c21 before they had correctly 
answered c20. The addition of the PR in line 1 of the revised frame (Fig. 11) 
corrected this problem. 



Student Handbook Revisions 

Revisions in the Handbook included correction of a few typographical and 
content errors and inclusion of omitted pages. Student reaction and on-site 
observation were also used to make improvements in the second printing of the 
Handbook. 



0 
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c20 

1 de 0/32 

2 dt 0 3 0/6, 0/40,0/Instead of writing out, for example, 

"3 hundreds + 4 tens + 7 ones," we might 

use a chart like this: 

3 pa 60 

4 dti 7,0/2,7/40,0/Hun- 

5 dti 9 ,0/4 ,9/1 5 ,0/ dreds Tens Ones 

6 dti 8,17/2,8/23,17/ Numerals Word name 

7 dti 13,3/2,13/20,3 3 4 7 347 

8 dti 12,27/2 ,12/1 3 k 27/three hundred 

9 dti 14,27/2, 14/1 3, 27/fcrty-seven 

10 pa 60 

11 dti 18,3/2,18/12,3/3 6 7 

12 dti 17,27/2,17/13,27/three hundred 

13 dti 19,27/2, 19/13, 27/sixty-seven 

14 epi 18,20,2, 18/3, 20//3/C21 

15 ca 367/cc 

16 dt 24,0/2,24/40,0/Yes. 367 = 3 hundreds + 6 tens + 7 ones. 

17 pa 50 

18 de 24/2 

19 br prl 

20 un un 

21 24,0/2,24/40,0/No, try again. 

22 pa 30 

23 un un 

24 dt 24 ,0/2, 24/40 ,,0/The numeral is 367. Type 367. 

25 pa 30 
c21 1 pr 




Fig. 10. Frame print-out before revision 
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c20 



1 


pr 




2 


dt 


0/32 


3 


dt 


0,0/6 ,0/40,0/ Instead of writing out, for example, 




"3 1 


lundreds + 4 tens + 7 ones," we might 




use 


a chart like this: 


4 


pa 


60 


5 


dti 


7,0/2,7/40,0/Hun- 


6 


dti 


9,0/4,9/15,0/dreds Tens Ones 


7 


dti 


8,17/2,8/23,17/Numerals Word name 


8 


dti 


13, 3/2, 13/20, 3/3 4 7 347 


S 


dti 


12, 27/2, 12/1 3, 27/three hundred 


10 


dti 


14,27/2,14/13,27/forty-seven 


11 


pa 


60 


12 


dti 


18,3/2,18/12,3/3 6 7 


13 


dti 


17,27/2, 17/13, 27/three hundred 


14 


dti 


19 ,27/2 ,1 9/1 3 ,27/si xty-seven 


15 


epi 


18, 20/2, 18/3, 20//3/C21 


16 


ca 


367/ce 


17 


24,0/2,24/40,0/Yes. 367 «* 3 hundreds + 6 tens + 7 ones. 


18 


pa 


50 


i9 


de 


24/2 


20 


br 


prl 


21 


ur« 


un 


22 


dt 


24,0/2,24/40,0/No, try again. 


23 


pa 


30 


24 


un 


un 


25 


dt 


24,0/2,24/40,0/The numeral is 367. Type 267. 


26 


pa 


30 


cr! 1 


pr 





Fig. 11. Frame print-out after revision— OP code revisions. 
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On-line Course Evaluation 

Two forms of a general achievement test have been put on-line--the pre- 
test (Form I), and the posttest (Form J). The 80 items or. the pre- and post- 
tests are all multiple-choice questions, and they can be answered by using the 
keyboard. All the students will receive the same six questions in the begin- 
ning and the same six questions at the end. The other 68 questions are 
randomly generated and therefore ary in the order in which each student 
receives them. 

The second test placed "on-line" is a 26-item mathematics attitude scale. 

It will be given to determine the student's attitude toward mathematics before 
and after completing the course. Since the choices on this test vary on a 
continuum from agree to strcngly disagree, students will respond by using the 
light pen. They will also be encouraged to make any comments they wish fol- 
lowing their response to each item. 

The use of on-line course evaluation was initiated for several reasons: 

1) to standardize and at the same time individualize the administration of the 
pre- and posttests, 2) to take advantage of student record feedback for 
future course revision, and 3) to gain the possibility of being able to investi- 
gate some of the problems related to testing students via CAI. 
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APPENDIX A 



Course Description: 




el math 



COURSE DESCRIPTION: el math 



The CAI course el math is designed to present mathematical content and 
methods of teaching that content in the elementary school. The content com- 
ponent was developed at The Pennsylvania State University by Dr. C. ATan 
Riedesel and Dr. Marilyn li. Suydam. The methods component was developed by 
Dr. Cecil R. Trublood with Dr. Riedesel and Dr. Suydam. 

The primary purpose of the content materials is to present the mathemat- 
ics which a teacher should know in order to develop a successful program in 
the elementary school. It is based on CUPM recommendations for Level 1 
courses, modified to meet the actual requirements of the schools in which it 
is visualized for use. The methods materials place stress on various strate- 
gies and techniques, including the use of manipulative materials. 

As over-all learning outcomes, the teacher should be able to understand 
and apply: 

(1) the mathematical content 

(2) generalizations about teaching procedures, including: 

(a) Physical world situations should be used to 
facilitate concept development. 

(b) Many varying materials should be used to facilitate 
concept development. 

(c) Experiences should range from the concrete to the 
abstract. 

(d) Individual differences must be considered in 
planning and in teaching. 

(e) Pupils should be asked to discover and use many 
varying ways of finding solutions to problems. 

(f) Pupils should be asked to explain, deduce,, generalize, 
and apply. 

(g) Questions of many types should be asked to provoke 
discussion, develop concepts, and refocus on problems. 

In addition to the CAI program, a textbook on teaching elementary school 
mathematics is required: Riedesel, C. Alan, Guiding Discovery in Elementary 

School Mathematics (New York: Appleton-Century-Crofts, 1967). A handbook 

with a summary of mathematical content and a section ori activities and 
materials to use in the classroom is also provided: Part I, Help to You in 




Learning Mathematics , by Roy F. Shortt (Keuka College, Keuka Park, New York), 
and Part II, Help to You in Teaching Mathematics , by Cecil R. Trueblood (The 
Pennsylvania State University). 

For use in evaluation of learning, there are an eighty-item test ("A Test 
on Modern Mathematics," Forms G and H, by Marilyn N. Suydam, Cecil R. Trueblood, 
and C. Alan Riedesel) and an attitude scale ("Attitude Toward Mathematics," by 
Marilyn N. Suydam and Cecil R. Trueblood). A scale to measure changes in 
attitude toward CAI is also available. 

An outline of the course follows. 




Chapter 1 : Sets and Early Number Experiences 



Content 



1. 


Sets 






a. 


Elements of sets 




b. 


Finite end infinite sets 




c. 


Defined sets 




d. 


Set notation 




e. 


Empty set 




f. 


Universal set 




g. 


Subsets 


2. 


Set 


relationships 




a. 


Equality 




b. 


Equivalence 


3. 


Set operations 




a. 


Union 




b. 


Intersection 



4. Complement of a set 
Methods 



This section focuses attention on why and how sets are presented in early 
number work. Attention is also directed toward the materials and techniques 
the teacher should use and the questions she should ask. Levels of pupil per- 
formance are considered in terms of types of pupil response. 




Chapter 2 : Exponents 



Content 



1. Interpreting exponential notation 

a. Repeated factors 

b. Powers: base and exponent 

2. Expressing in exponential form 

3. Expanding from exponential form 

4. Computation with exponents 

a. Multiplication 

b. Division 

c. Addition and subtraction 

5. Zero as an exponent 

6. Using expanded notation 



Methods 



How to teach exponential notation so that pupils see its usefulness is 
featured. Various pupil-teacher exchanges are presented. Use is made of graph 
paper and blocks to illustrate exponential forms. 



Chapter 3 : The Hindu-Arabic System 



Content 

1. Numerals and word names for numbers 

2. Place value 

a. Numerals and names through thousands place 

b . Patterns 

(1) Powers of 10 

(2) Expanded form and standard numerals 

c. Chart: periods and place value through quadrillions 

(1) Reading the numeral 

(2) Completing the chart 



Methods 



Introducing pupils to the use of place value charts is considered, 
is connected with work with the abacus and multi-base arithmetic blocks, 
reading of numerals to quadrillions is also considered. 
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Chapter 4 ; Gther Numeration Systems 



Content 

1. Introduction to base eight 

a. Symbols: counting 

b. Place value 

c. Changing from base ten to base eight 

(1) Finding powers of the base 

(2) Division by the base 

2. Introduction to base five 

a. Changing from base five to base ten 

b. Changing from base ten to base five 

3. Characteristics of any numeration system 

a. Number of symbols 

b. Writing the base 

4. Introduction to base twelve 

a. Changing from base twelve to base ten 

b. Changing from base ten to base twelve 

5. Introduction to base two 

a. Changing from base ten to base two 

b. Changing from base two to base ten 

6. Addition in other bases 

a. Base five 

b . Base two 

7. Multiplication in base five 



Methods 



Ways of introducing other numeration systems are presented. Use of mate- 
rials such as the place value chart is considered, and attention is directed 
to points at which pupils may have difficulty. 




Chapter 5: Addition of Whole Numbers 



Content 

1. Addition as a binary operation 

2. Addition as one of ^our operations 

a. Relation to subtraction 

b. Relation to multiplication 

3. Addition as the union of disjoint sets 

4. Counting as the basis for addition: use in problem solving 

5. Aids for teaching addition 

a. Abacus 

b. Number line 

c. Cuisenaire rods 
d„ Place value frame 

6. Properties and principles of addition 

a. Closure 

b. Commutativity 

c. Associativity 

d. identity element 

7. Addition basic facts: use of the table 

8. Addition algorithms for multi -digit examples 

a. Use of place value 

b. Use of properties 

c. Regrouping 

d. Expanded notation forms 

9. Historical forms for addition 

a. Sandboard method 

b. Scratch method 

c. Front-end addition 

10. Checking addition 

a. Excess of nines 

b. Excess of elevens 



Methods 



For this chapter, the methods component is interwoven with the content. 
Stress is placed on the use of verbal problems and manipulative materials such 
as the abacus and Cuisenaire rods. 




Chapter 6 : Subtraction of Whole Numbers 



Content 

1. Subtraction on the number line 

2. Subtraction as the inverse of addition 

3. Terminology 

a. Addend, missing addend, sum 

b. Minuend, subtrahend, difference 

4. Subtraction in terms of sets 

a. Complements 

b. Difference between universal set and subset 

5. Properties and principles of subtraction 

a. Closure 

b. Commutativity 

c. Associativity 

d. Compensation and renaming 

6. Subtraction basic facts: use of the addition table 

7. Subtraction algorithms 

a. For basic facts 

(1) Additive method 

(2) Take-away method 

b. For multi -digit examples 

(1) Decomposition 

(a) Additive 

(b) Take-away 

(2) Equal additions 

(a) Additive 

(b) Take-away 

3. Checking subtraction 

a. Adding 

b. Excess of nines 

c. Excess of elevens 

do Complementary method 

e. Scratch method 

9. Subtraction in base eight 



Methods 



Procedures for introducing subtraction to pupils are developed. Also 
reintroduction using the abacus as a vehicle is presented, and attention is 
focused on ways of teaching multi-digit subtraction using expanded notation. 




Chapter 7: Multiplication of Whole Numbers 



Content 

1. Multiplication as repeated addition. using the number line 

2. Terminology 

a. Multiplier; multiplicand, product 

b. Factors and product 

3. Multiplication in terms of sets 

4. Arrays and ordered pairs 

5. Properties and principles of multiplication 

a. Identity element 

b. Closure 

c. Commutativity 

d. Associativity 

e. Distributivity 

6. Multiplication basic facts: use of the table 

7. Multiplication algorithms for multi -digit examples 

a. Regrouping 

b. Use of place value 

8. Checking multiplication 

a. Use of properties 

b. Excess of nines 

c. Excess of elevens 

9. Historical forms for multiplication 

a. Finger reckoning 

b. Lightning method 

c. Scratch method 

d. Lattice method 

e. Ouplation methods 

10. Modulus multiplication 

a. Mod 2 

b. Mod 7 



Methods 



Use of arrays in teaching multiplication is developed. Emphasis is placed 
on providing pupils with varying methods for finding answers to multiplication 
questions. 




Chapter 8 : Divisio n of Whole Numbers 



Content 



1. Relation of division 

a. To multiplication 

b. To subtraction 

2. Terminology 

a. Dividend, divisor, quotient 

b. Types: partition and measurement 

3. Properties and principles of division 

a. Closure 

(1) Exact division 

(2) Inexact division 

b. Commutativity 

c. Associativity 

d. Right distributivity 

e. Use of zero except as a divisor 

f. Identity element 

4. Division algorithms 

a. For basic facts: use of the multiplication table 

b. For multi-digit examples 

(1) Subtracting groups of the divisor 

(2) Use of place value 

(3) Estimation of quotient 

(a) Approximation 

(b) Compensation 

(c) Determining devisibility 

5. Historical forms for division 

a. Galley method 

b. A danda method 

c. Division by factors 

d. Excess of nines 

6. Division in base four 



Methods 



Procedures for the diagnosis of pupil difficulties in division are devel- 
oped. Provision for individual differences is focused on through the study of 
procedures for estimating the quotient in division. 




& 



Chapter 9 : Functions 

(to be developed) 




Chapter 10: Integers 



Content 

1. Defining the set of integers 

a. Negative signed numbers 

b. Additive inverse 

2. Computation with integers 

3. Properties and principles of integers 

a. Closure 

b. Commutativity 

c. Associativity 

d. Distributivi ty 

e. Identity element 

4. Order relations of integers 



Methods 



Three strategies for introducing a lesson are analyzed and compared. The 
way in which a teacher can use a textbook with other materials is developed. 




Chapter 11 : Fractions 



Content 

1. Defining the set of rational numbers 

2. Terminology of fractions 

3. Uses of fractions 

a. To express parts of a group and parts of a whole 

b. To name a rational number 

c. To indicate division 

d. express a ratio 

4. Characteristics of fractions 

a. Identity element 

b. Equi valance 

c. Cross-products test 

d. Renaming in simplest form 

(1) Prime numbers 

(2) Composite numbers 

(3) Numbers that are relatively prime 

5. Order relations of fractions; mixed forms 

6. Properties of fractions 

a. Commutativity 

b. Associativity 

c. Distributivity 

7. Computation with fractions 

a. Addition 

(1) Like denominators 

(2) Unlike denominators 

b. Finding the L. C= M. 

c. Finding the G. C. D. 

d. Subtraction 

(1) Like denominators 

(2) Unlike denominators 

e. Multiplication 

f. Division 

(1) Common denominator method 

(2) Multiplicative inverse method (inverse) 



Methods 



Attention is focused on a lesson plan for summarizing the various uses 
of fractions. The selection of behavioral objectives and analysis of 
strengths and weaknesses of the plan are included. 




Chapter 12: Decimals 



Content 



1 . 


Place value for decimals 


2. 


Reading and writing decimals 


3. 


Locating decimals on the number line 


4. 


Renaming 

a. Fractions as decimals 

b. Decimals as fractions 


5. 


Terminating decim?ls 


6. 


Non-terminating decimals 

a. Repeating 

b. Non-repeating 


7. 


Computation with decimals 


Methods 





Use of a physical world situation to introduce decimals is emphasized with 
the presentation of a lesson with an odometer. Pupil participation through the 
use of multiple solutions is reviewed, and non-verbal problems are suggested. 




Chapter 13 : Ratio and Per Cent 



Content 

1 . Ratio 

a. Expressing ratios 

b. Solving problems with ratios 

c. Using the cross-product method 

2. Per cent 

a. Three types of problems 

(1) What is N% of a number? 

(2) What per cent is one number of another number? 

(3) Find the total (100%) when a per cent is known 

b. Five approaches to solving each type of problem 

(1) Decimal 

(2) Ratio 

(3) Unitary-analysis 

(4) Formula 

(5) Equation 



Methods 

This section is essentially a review and test of material presented in 
Chapter 10 of the course textbook by Riedesel. When and how ratio and per 
cent should be developed are emphasized. 




APPENDIX B 



Student Opinion Toward Computer-Assisted Instructi 




STUDENT OPINION TOWARD COMPUTER-ASSISTED INSTRUCTION 



1. 


The method by which I was told whether I had 
answer became monotonous. 


given a right or wrong 




Strongly Disagree Uncertain 

Disagree 


Agree 


Strongly 

Agree 


2. 


Nobody really cared whether I learned the course material or not. 




Strongly Disagree Uncertain 

Disagree 


Agree 


Strongly 

Agree 


3. 


I felt challenged to do my best work. 








Strongly Disagree Uncertain 

Disagree 


Agree 


Strongly 

Agree 


4. 


I felt isolated and alone. 








All the Most of Some of 

time the time the time 


Very 

Seldom 


Never 


5. 


I felt as if someone were engaged in conversation with 


me. 




All the Most of Some of 

time the time the time 


Very 

Seldom 


Never 


6. 


As a result of having studied by this method 
learning more about the subject matter. 


, I am interested in 




Strongly Disagree Uncertain 

Disagree 


Agree 


Strongly 

Agree 


7. 


I was more involved in operating the terminal than in 
the course material. 


understanding 




All the Most of Some of 

time the time the time 


Very 

Seldom 


Never 


8. 


The learning was too mechanical. 








Strongly Disagree Uncertain 

Disagree 


Agree 


Strongly 

Agree 


9. 


I felt as if I had a private tutor. 








Strongly Disagree Uncertain 

Disagree 


Agree 


Strongly 

Agree 


TO. 


The equipment made it difficult to concentrate on the 


course material 




All the Most of Some of 

time the time the time 


Very 

Seldom 


Never 
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11. 


The situation made me quite tense. 








Strongly Disagree Uncertain 

Disagree 


Agree 


Strongly 

Agree 


12. 


Computer-assisted instruction, as used^Kth 
inefficient use of the student's tirg< 


is course 


, is an 




Strongly Disagree^^ Uncertain 

Disagree 


Agree 


Strongly 

Agree 


13. 


My feeling towapd^fhe course material after 
was favorab] 5 -r 


I had completed the course 




Strongly Disagree Uncertain 

Disagree 


Agree 


Strongly 

Agree 


14. 


I felt frustrated by the situation. 








Strongly Disagree Uncertain 

Disagree 


Agree 


Strongly 

Agree 


15. 


I found the computer-assisted instruction approach in 
be inflexible. 


this course to 




Strongly Disagree Uncertain 

Disagree 


Agree 


Strongly 

Agree 


16. 


Material which is otherwise interesting can 
by CAI . 


be boring 


when presented 




Strongly Disagree Uncertain 

Disagree 


Agree 


Strongly 

Agree 


17. 


I was satisfied with what I learned while taking the < 


course. 




Strongly Disagree Uncertain 

Disagree 


Agree 


Strongly 

Agree 


18. 


In view of the amount I learned, this method 
classroom instruction for many courses. 


seems superior to 




Strongly Disagree Uncertain 

Disagree 


Agree 


Strongly 

Agree 


19. 


I would prefer computer-assisted instruction to traditional instruction. 




Strongly Disagree Uncertain 

Disagree 


Agree 


Strongly 

Agree 



20. Computer-assisted instruction is just another step toward de-personal 1 zed 
instruction. 



0 




Strongly Disagree Uncertain Agree Strongly 
Disagree Agree 



21. I was concerned that I might not be understanding the material. 

Strongly Disagree Uncertain Agree Strongly 

Disagree Agree 

22. The responses to my answers seemed appropriate. 

All the Most of Some of Very Never 

time the time the time Seldom 

23 . I felt uncertain as to my performance in the programmed course relative 
to the performance of others. 

All the Most of Some of Very Never 

time the time the time Seldom 

24. I was not concerned when I missed a question because nobody was watching 
me. 

Strongly Disagree Uncertain Agree Strongly 

Disagree Agree 

25. I found myself just trying to get through the material rather than 
trying to learn. 

All the Most of Some of Very Never 

time the time the time Seldom 

26 . I knew whether my answer was right or wrong before I was told. 

All the Most of Some of Very Never 

time the time the time Seldom 



27. 



In a situation where I am trying to learn something, it is important 
to me to know where I stand relative to others. 



Strongly 

Disagree 



Disagree Uncertain 



Agree 



Strongly 

Agree 



28. I guessed at the answers to some questions. 



All the 
time 



Most of 
the time 



Some of 
the time 



Very 

Seldom 



29. 



Never 

I was aware of efforts to suit the material specifically to me. 



All the Most of Some of Very Never 

time the time the time Seldom 

30. I was encouraged by the responses given to my answers of questions. 

Uncertain Agree Strongly 

Agree 



Strongly Disagree 
Disagree 



31. In view of the time allowed for learning, I felt too much material 
was presented. 

Strongly Disagree Uncertain Agree Strongly 
Disagree Agree 

32. I entered wrong answers in order to get more information from the 
machine. 



All the Most of Some of 

time the time the time 

33. I felt I could work at my own pace. 

Strongly Disagree Uncertain 

Disagree 



Very Never 
Seldom 



Agree Strongly 
Agree 



34, Questions were asked which I felt were not related to the material 
presented. 



All the Most of Some of Very Never 

time the time the time Seldom 



35. I was aware of the flickering screen while I was taking the course. 

All the Most of Some of Very Never 

time the time the time Seldom 



36. Material which is otherwise boring cau be interesting when presented 
by CAI . 

Strongly Disagree Uncertain Agree Strongly 

Disagree Agree 

37. I could have learned more if I hadn't felt pushed. 

Strongly Disagree Uncertain Agree Strongly 

Disagree Agree 

38. I was given answers but still did not understand the questions. 



All the Most of Some of Very Never 

time the time the time Seldom 



39. The course material was presented too slowly. 

All the Most of Some of Vary Never 

time the time the time Seldom 

40. The responses to my answers seemed to take into account the difficulty 
of the question. 



Agree 



Strongly 

Agree 
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Strongly Disagree 
Disagree 



Uncertain 



41. While on computer-assisted instruction, I encountered mechanical 
malfunctions. 

All the Most of Some of Very Never 

time the time the time Seldom 

42. Computer-assisted instruction did not make it possible for me to 
learn quickly. 

Strongly Disagree Uncertain Agree Strongly 

Disagree ' Agree 
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